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Abstract. The paper examines questions of local asymptotic stability of ran- 
dom dynamical systems. Results concerning stochastic dynamics in general 
metric spaces, as well as in Banach spaces, are obtained. The results pertain- 
ing to Banach spaces are based on the linearization of the systems under study. 
The general theory is motivated (and illustrated in this paper) by applications 
in mathematical finance. 



1. Stochastic dynamics and equilibrium 

Let (QjJ 7 , P) be a probability space and T : — > f2 its endomorphism, i.e., an 
^-measurable map preserving the probability P: 

P(T- 1 (T)) = P(T), re J. 

Let (X, X) be a measurable space and f(x,ui) a jointly measurable mapping of 
X x Q into X. These data define a discrete-time (autonomous) random dynamical 
system with the state space X, the law of motion f(x,w) and the time shift T. For 
each t = 1, 2, we put 

(1.1) f t {x,u):=f{x,T t - 1 u). 

A sequence xo(w), x\(lu), ... of random elements in X is called a path of the random 
dynamical system if 

(1.2) xt(u) = f t (xt-i(u),u), t = 1,2,.... 
almost surely (a.s.). A random element x(u>) e X satisfying 

(1.3) x(Tu) = f(x(u)),u)) (a.s.) 

is termed a stochastic equilibrium (or a random fixed point, or a stationary point) of 
the system. The sequence xt(u>) := x(T u>), which satisfies Xt{oj) = ft(xt-i{uj),uj) 
(a.s.) by virtue of (jl.3|) . represents the equilibrium path of the system generated 
by the random fixed point x(w). For each a £ X, we denote by Xq(oj), xf (w), ... 
the path with the initial state a — the sequence of random elements generated 
recursively (for each oj and all t > 1) by equations (|1.2[) with xq(u) = a. 
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2. Basic assumptions 

Let x(oj) be a stochastic equilibrium and let X(uj) Clbea random selQ such 
that x(id) G X(ui) and f(x,ui) G X(Tcj) for each x G -X"(cj) and wgO. Let p be a 
metric on X. For any number 5 > 0, define 

X(w,<5) := {> G : p(x,x(u)) < 5}. 

We introduce two hypotheses, (A) and (B), that will be needed for the statement 
of the main results. 

(A) X is a complete separable metric space with the metric p(x, y) and the Borel 
CT-algebra X. There exist random variables L(uS) > and 8(ui) > such that 

(2.1) E\\nL\ < +oo, E\ln5\ < +oo, 

(2.2) E\nL<0, 
and 

(2.3) p(f(x,u),f(x(u),u)) < L(uj)p(x,x(uj)) 

for all x G X(uj,5(uj)). Here, "E" stands for the expectation with respect to the 
probability measure P. 

It is assumed in (A) that the mapping f(-,uj) is locally Lipschitzian at the 
equilibrium point x(w) (in a 5(oj)-neighborhood of x(u>)) with the random Lipschitz 
constant L(uj). Conditions (12.1[) guarantee that the random Lipschitz constant is 
not "too large" and the random <5(o>)-neighborhood is not "too small." (We could 
assume that E\n + L < +oo and E In - 5 > — oo, but this would not lead to a gain 
in generality.) According to (|2.2p . L{iS) has negative expected logarithm, so that 
the mapping f(-,Lu) is locally contracting on average. 

The next hypothesis pertains to the case of a linear space X. It provides con- 
ditions guaranteeing the validity of (A) formulated in terms of the linearization of 
the mapping f(-,ui) at the equilibrium point x(lu). 

(B) X is a separable Banach space with the norm || • ||, the metric p{x,y) := 
\\x — y\\ and the Borel er-algebra X. 

(Bl) There exist random variables L(lu) > and 5(uj) > for which conditions 
(I2.1j) hold and the mapping f(x,ui) satisfies (|2.3p for all x G X(uj,5(uj)). 

(B2) For each w, there exists the derivative f'(x(uj),bj) of the mapping f{-,uj) 
at the point x(uj), and 

E\n\\f'(x(u),u)\\<0. 
The derivative is understood in the strong (Frechet) sense, as a continuous linear 
operator F(u>) :— f'(x(ui),uj) such that 

(2.4) f(x(u) + h,u) = f{x{oj),Gj) + F(w)h + g(h,oj)\\h\\, h G X, 

where g(h,u) — > as \\h\\ — s> 0. The norm \\F\\ of the operator F is defined as 
sup{||F/i||/||/i|| : / ft £ I). Note that hypotheses (A) and (Bl), in contrast 
with (B2), impose assumptions on the behavior of the mapping fix, uj) only in the 
intersection of a neighborhood of the point x(uS) with the set X(u>) (which might 
be significantly smaller than the whole neighborhood). 

Throughout the paper we will assume that the endomorphism T is ergodic: all 
invariant sets have either zero or full measure. 



We say that X (ui) is a random set if the graph {(«, u) S X X Q : u S X(ui)} of the multivalued 
mapping 10 i— ¥ X(uj) belongs to the tr-algebra X ® T. 
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3. Central result 

Theorem 1. Let hypothesis (A) or hypothesis (B) hold. Then there exist a random 
variable 7(0;) > and a constant c < such that with probability one, 

(3.1) limsupt^ -]np{x%{u),x t (u))) <c 

for all a £ X(uj,j(ui)). 

The theorem shows that for all u> in a set fii of measure 1, the distance between 
the path x"(oj) with the initial state a and the equilibrium path Xt(ui) tends to 
zero at an exponential rate for all a in a sufficiently small neighborhood X (u>, 7(0;)) 
of x(u>). This convergence and its rate are uniform with respect to uj £ fii and 
a 6 X(uj, 7(0;)). 

The results of this paper are motivated by applications in evolutionary finance 
[12] — a new and rapidly developing area in financial mathematics. The general 
mathematical framework for models in this area is the ergodic theory of random 
dynamical systems. For the analysis of evolutionary models of asset markets, one 
often needs to examine local stability of stochastic equilibria of some dynamical 
systems. Surprisingly, the literature does not contain results which would be quite 
suitable for applications in this field. The main tools offered for local analysis in the 
context of stochastic dynamics (see the classical monograph by L. Arnold PQ) are 
stochastic analogues of the Hartman-Grobman theorem [T7J - [TH] developed in [3S] 
and [5J - [7J , and closely related results on stable manifold theorems [H (27J 1301 
[331 135] ■ For the most part, these are delicate results, the use of which requires the 
verification of complex conditions. They are much stronger than what is needed for 
our purposes and require much stronger assumptions. The need for suitable tools 
motivated us to develop the techniques described above. To use Theorem Q] under 
hypothesis (B) one has essentially to estimate only the expectation of one random 
variable: the logarithm of the norm of the derivative f'(x,Lu) at the random fixed 
point x — x(lu) (the local Lipschitz property (Bl) usually causes no problems). The 
theorem represents a direct stochastic analogue of well-known deterministic results 
on local asymptotic stability. Its statement and proof are based on elementary 
notions and techniques. 

By and large, stochastic equilibria, or random fixed points, exist under suffi- 
ciently strong assumptions^ In many cases such assumptions guarantee not only 
existence, but also global asymptotic stability established simultaneously as a con- 
sequence of a stochastic contraction principle Q21 [36] . Global asymptotic stability 
— convergence to a limit from any initial state — implies that the limit forms an 
equilibrium. Of course in such cases, local analysis is superfluous. This is the situa- 
tion, for example, with stochastic equilibrium problems related to random Perron- 
Frobenius theorems [31 DZ3 [12 H2J H3] ■ Results in that field have been primarily in- 
spired by the applications in the theory of Gibbs measures [33l [37] , large deviations 
[25] . models in mathematical biology [5], and others (see also (2H1 HU [35] ) . In many 
models coming from economics and finance, the situation is different. The ques- 
tions of existence are often separated from the questions of stability, and existence 
proofs based on the above methods require too restrictive, unjustifiable assump- 
tions. Typically, either the system has an obvious, even deterministic, fixed point, 



Counterexamples in 1141 1311 substantiate this assertion. 
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or the existence is proved by methods quite distinct from the above-mentioned ar- 
guments based on global stability and limiting procedures (see, e.g., studies on von 
Neumann-Gale dynamics [21 [TS]). In the example we consider at the end of the 
paper, we deal with the former case: the system is random but the fixed point is 
deterministic. 

The remainder of the paper is organized as follows. In section |4] we prove Theo- 
rem [U At the end of the section, we provide a condition sufficient for the validity 
of hypothesis (Bl). Section [5] gives an extension of Theorem Q] applicable both to 
continuous and discrete time settings. Sections [5] and [7] analyze an example related 
to mathematical finance. 



4. Proof of Theorem [T] 

1st step. Assume that hypothesis (A) holds. Replacing by its subset of 
full measure, we can (in view of (|1.3|) ) assume without loss of generality that the 
equations x t +\{uj) = ft(xt(to),to) hold for all t and all u>, rather than almost surely. 
Define X t (u) := X(T f uj), S t (u) := <5(T*w), L t (u)) := L^^u) and 

X t (u) := {x G X t (uj) : p(x,x t (uj)) < 8 t (w)}. 

It follows from (1231) that 



sup p(f t (x,u),x t (u))) < L t (uj)p(x,x t -i(uj)). 

l£X t -l(w) 

This implies the validity of the following assertion: 
(*) if ^HelnH, then 

p(x%(w),x t (u>)) < L t {u))p{xl_ 1 {uS),x t - 1 (u)). 

We claim that there exists a random variable 7 (w) > for which the inequalities 

(4.1) 7 («) < *„(«), 

(4.2) Lt(w)...Li(w)7(o;) < <5t(w), t = 1, 2, ... 

hold with probability one. Indeed, these inequalities are satisfied if and only if 

/ * q \ , x L t (uj)...L Q (uj) 1 

(4.3) <j{uj) := sup — < 

t=o,i,... Ot(uj) j(oj) 

where Lq(uj) := 1. It is sufficient to show that P{a < oo} = 1. Then relation (j4.3l) . 
and hence inequalities (14.1[) and (I4.2p . hold a.s. for the random variable 7 defined 
as y(oj) = l/cr(c<;) if ct(w) < 00 and 7(0;) = 1 otherwise. To prove that a < 00 a.s., 
we use the ergodic theorem and obtain that 

-ln Lt -; L ° = lV InL, - iln(5 t -> E\nL < (a.s.), 
t St t ^— ' i 

since £J|lnL| < 00 and £J|ln<5| < 00. Consequently, Lt.-.L^St 1 — > a.s., which 
implies that P{u < 00} = 1. 

Consider the random variable 7(0;) > constructed above and denote by the 
set of those ui for which inequalities (|4.1I) and (|4.2[) hold and additionally, 

1 - 

(4.4) lim^oo -J^lni, = ElnL. 

i=0 
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This relation holds a.s. by virtue of the ergodic theorem, and so P(f2i) = 1. Take 
any uj G f2i and a G X(oj) satisfying p(a,x(ui)) < 7(w). Let us show by induction 
that for all t > 0, 

(4.5) x a t (uj) G X t (w), 

(4.6) p{x a t {u),x t {u>)) < Lt(w)...L (w)7(w). 
For £ = 0, we have a G Xo(w) = X(ui) by assumption and 

(4.7) p(a,x(u>)) <j(lu) < 5o(u) 

by virtue of (14.11) . so that Xq(uj) G Xo(w). Inequality (|4.6p is true for £ = in view 
of (|4.7[) and because 7(0;) = L (u;)7(aj). Suppose relations (|4.5[) and (|4.6I) are valid 
for some £. Then x% +1 (ui) G X t+ i(w) because 

P^t+iM^i+iM) < L t+ x(u)p(x%(uj),xt(u)) < L t+1 (uj)L t (uj)...L Q (uj)j(uj), 

where the first inequality follows from assertion (*) and (|4.5I) . while the second is 
a consequence of (I4.6p . By using (|4. 2[) (with £ + 1 in place of £), we conclude that 
p(xt +1 (u)), Xt+i(u})) < 6 t +i(uj), which proves that the analogues of relations (|4.5j) 
and (|4.6j) hold for £ + 1. Inequality (|4.6|) combined with (|4.4j) implies (|3.1|) with 
c := EItlL. 

2nd step. To complete the proof of Theorem Q] we show that (B) implies (A). 
In this connection, we make some comments regarding measurability. By applying 
(|2.4p with k~ 1 h in place of h, letting k 00, and using the joint measurability of 
f(x,ui), we obtain that the mappings F(w)h and g(h,w), and hence the functions 
||F(oj)/i|| and \\g(h, w)||, are jointly measurable in (h,uj). The operator norm F(ui) 
depends measurably on uj because ||-F(w)|| := sup fc {||F(w)/i/ c ||/||/ifc||}, where {hk} 
is a countable dense subset in X\{0}. 

By using (|2.4I) and (|2.3I) . we obtain that for each x G X(ui, 6(ui)), 

\\g(x - x(u),u)\\ \\x - x(w)\\ < \\f(x,u) - f(x(u),u)\\ + \\F(w)(x - x(u))\\ < 
L(u)\\x-x(u)\\ + \\F(u)\\\\x-x(u)\\, 

which implies 

(4.8) \\g(x-x(iu),u)\\<L(u) + \\F(uj)\\. 
Further, if x G X(uj,8(uj)), then 

(4.9) \\f(x,u>) mw), U )\\ < [\\F(u)\\ + \\g(x - x(u),u)\\] \\x 
Define 

(4.10) g k (io) := sup{||g(a; - x(lu),u)\\ : x G X(u, fc _1 <5(w))}. 

The function gk(oj) is measurable with respect to the completion J- p of the a- 
algebra J- by P-null sets because \\g(x — x(lo),uj)\\ is jointly measurable in (x,oj) 
and X(lu) is a random set. This follows from the fact that the projection of a set 
in X (g) T on fl is J rP -measurable (see, e.g., jS], Theorem III. 33). 

Define Dfc(cj) := ||F(w)|| + g k (uj). By virtue of (|2.4p . gfe(w) -> for each w. 
Furthermore, in view of (|4.8I) we have 

lnL> fe (w) < ln[2||F(w)|| < In 4 + max[ln \\F(w)\\, ln£(w)] =: S(w), 

where i?|S(a;)| < 00. By using Fatou's lemma, we get 

lim sup,^ E In D k (u) < E \xm k ^oc In D k (u) = E In ||F(w) || < 0. 
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Thus there exists k such that E1nDk(u>) < and (by virtue of (|4~9|) and (|4.10p ) 

\\f(x,oj) - f(x(u),u)\\ < D k (u)\\x - x(u)\\ 
for each x G X(ui,S(u>)/k). This completes the proof of Theorem [TJ □ 

Remark 1. The following assumption is sufficient for condition (Bl) to hold. 

(B3) There exist random variables L(lj) > and S(lu) > satisfying (|2.1[) such 
that for all x G X(w,S(u))), the set X(w) contains the segment [x(oj),x] connecting 
x(ui) and x, the mapping f(x,uj) is diffcrcntiable at the point x, and the norm of 
the derivative \\f'(x, is bounded from above by L(u). 

To deduce (Bl) from (B3) it suffices to observe that the inequality ||/'(a;, w)\\ < 
L(u>) implies (|2.3|) by virtue of the generalized mean value theorem: 

\\f(x,w)-f(x(u),u)\\<\\x-x(u>)\\ sup 

(which holds even if f'(x,oj) is the weak rather than the strong derivative) — see 
[H], Section X.1.3. 

5. Extension to discrete and continuous time cocycles 

The next result provides an extension of Theorem[T]to random dynamical systems 
defined in terms of cocycles in discrete and continuous time. Let T be either the set 
of non- negative integers or the set of non- negative real numbers, and let T , t G T, 
be a semigroup of ergodic endomorphisms of the probability space (fi, J 7 , P). For 
each t £ T let Ct(x, u>) be a jointly measurable mapping of X x fl into X. Assume 
that the family of mappings Ct(x,oj), t € T, forms a cocycle, i.e., 

C t +s(;w) = C s (-,T*a;) o C t (-,w), C q (x,uj) = x, 

for all t,s,x and w. The cocycle defines the law of motion in the system, whose 
paths are random functions x t (uj), t 6 T, such that with probability one, Xt(u>) — 
Ct{xo(u), uj) for all t £ T. Random dynamical systems of this kind can be generated 
by stochastic or random differential equations in continuous time and by products 
of random mappings in discrete time (see Q~]). We will assume that a random set 
X(cj) is given such that Ct(x,ui) G X(T*cj) for all x G X(w). 

Let Xt(io), t G T, be an equilibrium path, i.e., a path satisfying a.s. Xt(uj) = 
5o(T t w) for all tel. For each a G X , define x^(oj) := C t (a,uj) (the random path 
with the initial state a). 

Theorem 2. Let the following assumptions hold: 

( CI ) There exists M G T such that the mapping Cm(-,w) satisfies condition (A) 
or (B) with x(uj) = xq(uj). 

( C2) There are random variables H{uS) > 0, k(uj) > and a constant b > such 
that E\ hxH(w)\ < +oo, E\ \d.k{ui)\ < +oo and with probability one, 

(5.1) p(Ct(z,u),C t (x(u),uy) < H(u)p(x,x(u)) b 

for all x G X{uj, k(lj)) and t £ T satisfying < t < M . 

Then there exist a random variable 7(w) > and a constant d < such that 
almost surely 

(5.2) limsupTgt^ jlnp(x°(u),x t (u})) < d 
for all a G X(oj,j(u})). 
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Since d < 0, (|5.2|) implies that p(x%(u)),Xt(uj)) — > a.s. at an exponential rate. 
This convergence, as well as its rate, are uniform with respect to uj in a set f2i of 
full measure and all a in the neighborhood X(ui,^f(uj)) of x(lu) = xo(ui). Property 
(|5.ip represents a Holder condition on the cocycle Ct(x,uj). 

Proof of Theorem^ Since (B) implies (A), as we demonstrated in section |4l 
it is sufficient to prove the theorem under assumption (A). Define tin) :— nM, 

n = 0,1 By applying Theorem [T] to the mapping f(x,oj) :— C'm(x,lu), we 

obtain that there exist a random variable 7(0;) > and a constant c < such that 
with probability one, 

(5.3) limsup^^ ^ylnp« (n) (w),x t(n) (u;)) < c 

for all a € X(u>, 7(w))- From ()5.3|) we obtain that for each e G (0, 1) with probability 
one, 

(5.4) p n {u) := p{x a t(n) (w), x t{n) (cj)) < exp[*(n)c(l - e)] 
for all sufficiently large n. Furthermore, almost surely 

(5.5) K„(u) := K(T t( ^uj) > exp[t(n)c(l - e)] 

for all n large enough. Indeed, the last inequality holds if Mc(l — e) < nT 1 lnre n (w), 
which is true for all n large enough because limn-^ n^ 1 In n n {uj) — > a.s. (this 
follows from the assumption E\\x\k{lu)\ < +00). From (|5.4|) and f|5.5[) we obtain 
that the inequalities 

(5.6) PnM < K n (u) 

a.s. hold for all n large enough. By using (C2) and (|5.6j) . we obtain that for each 
e > with probability one, 

J7 n (w) := sup -]np(xt(u)),x t ((j)) < 

t(n)<t<t(n+l) * 



sup 

t(n)<t<t(n+l) 



ln + if(T*(")a;) 6, , . . , 

+ -lnp(x t(n) (u),x t{n) (u)) 



< 



ln+ H(T t( - n ^uj) bt{n)c(l - e) _ ln + H(T t( - n ^uj) bnc(l - e) 

t(n) t{n)<t<t{n+i) t t(n) n + 1 

for all n greater than some n(ui). The first summand in the last expression converges 
to zero a.s. by virtue of the assumption E\hiH\ < +00. The second summand 
tends to bc(l — e). Consequently, with probability one, there exists k(uj) such that 
?7n(w) < bc(l — e) 2 for all n > k(u). Denote by N(t) the natural number such 
that MN(t) < t < M[N(t) + 1]. Then t' 1 lnp{x?{u), x t (u)) < rj N (t){u)- Thus if 
t > Mk(uj), then N(t) > k(u>), and so 



t 1 \np{x?(uj),x t (uj)) <n N ( t )(u) < bc(l 



■ £ 



,2 



Since e is any number in (0, 1), we obtain that (|5.2I) holds with d := be (< 0). The 
proof is complete. □ 

Remark 2. Applying Theorem [2] in the discrete-time case, where T = {0,1,...}, 
to the cocycle defined by 

C t (.,w) :=/t(-,w)o...o/ 1 (.,a;) ) t > 1, 
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we obtain a version of Theorem [T] in which condition (A) or (B) is imposed not on 
the given mapping /(•, oS), but on the product Cm (•, u>) — /m(") u) o ... o uj) of 
the mappings f t (-,uj). In this case, hypothesis (C2) is fulfilled under the following 
assumption. 

(C3) There exist random variables L(uj) > and S(ui) > for which conditions 
([2~T]) and ([231) h «ld. 

Indeed, assume that (C3) is satisfied and put 

k{w) := mm . . — , 
o<t<M L (w)...L t (w) 

where L t and <5t are defined in section |4] Arguing by induction and using (|2.3j) . we 
obtain that 

/ o(Cj(a;,£j),C , t (x(a;),w)) < L (cj)...L t (u>)p(x, x(u)) < S t (uj) 

(t = 1,2, M), as long as p(x,x(u>)) < k(ui). This yields (C2) with b — 1 and 
:= Ii(u))...LmH- 

Remark 3. Assume that X is a separable Banach space and for each w, the map- 
ping Ct(-,uj) is differentiable at the point Xo(lu) and continuous in a neighborhood 
of this point. Then the family of linear operators F t (uj) — C' t (xo(uS),uS) forms a co- 
cycle (this follows from the chain rule of differentiation) — the linearization of the 
cocycle Ct{x,ui). Suppose that E\n + ||.F t (u;)|| < +00. In this case, the assumption 
that E\a. \\Fm{u)\\ < for some M > 0, needed for the application of Theorem [2] 
under hypothesis (B), is equivalent to the assumption that the Furstenberg-Kesten 
constant [T6 | [32 l fT] 

lim^oo jEln \\F t (w)\\ = inf jEln \\F f (w)\\ 

is negative. 



6. Application to an investment model 

To describe an example to which we will apply Theorem [1] assume that together 
with the probability space (f2, T , P) and its endomorphism T, we are given a family 
of er-algcbras Tq C T\ C ... C T such that T _1 (r) G Ft+i if and only if T 6 T t 
{Tt contains events observable prior to time t). Denote by A the unit simplex 
{v = (vi,...,v K ) > : J^Vk = 1}. Let R t (u>) = iJ(T*w), A t (w) = A(T*w) and 
Aj(w) = X*(T 1 uj) be stationary processes with values in A adapted to the filtration 
{T t ) and r a number in (0, 1) such that 

(6.1) rE t \*{Tuj) + (1 - r)E t R{Tu) = \*{uj) (a.s.), 

where E t {-) = E(-\J- t ). The existence and uniqueness of the solution A*(-) to 
equation (|6.1[) follows from the Banach contraction principle and the fact that 
r < 1. 

Consider the random dynamical system whose paths (xt) are defined by 

Ef=JrA t * +1)fc + (1 - r)R t+1 , k ] A ^ 

(6.2) x t+ i = x t ^ , 

EfciK+U: + (1 - r)R t +i,k}- 



\ t kX t + A 



l.k 
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where Rt,k, Xt,k, and X* k are the coordinates of the vectors Rt, At, and X* t , re- 
spectively. In the evolutionary model of an asset market developed in jTTJ [TJ] (see 
these references for details), Rt,k are relative dividends of K assets, the sequences 
of vectors A = (At) and A* = (A|) are investment strategies (portfolio rules) and 
r is the investment rate. The vectors At 6 A and AJ 1 € A indicate proportions 
according to which investors using the strategies A and A* allocate wealth across 
assets. The strategy A* defined by (|6.ip is a generalization of the Kelly portfolio 
rule, well-known in mathematical finance (see, e.g., [IB])- It is assumed that there 
are two groups of investors, one using the strategy A* and the other any strategy A 
distinct from A*. The variable Xt represents the ratio Wt/w^ where and Wt de- 
note the total wealth of the former and the latter groups of investors, respectively. 
The local stability of the dynamical system under consideration at the fixed point 
x = means that the portfolio rule A* is evolutionary stable. If the initial relative 
wealth xq = a of the A- investors ("mutants" — in the terminology borrowed from 
biology) is small enough, then they will be eventually driven out of the market by 
the A*-investors: their relative wealth x% will tend to zero. 

Define X* k := Aq k and assume that the following conditions hold. 

(Kl) #lnmin fc Aj: > — oo. 

(K2) The random variables fik ■— rX* k + (1 — r)Rx^, k = 1, K , arc condition- 
ally linearly independent given Fq, i.e., the equality ai/ii + ... + olk^k = holding 
(a.s.) for some J-o-measurable random variables cxk implies a± = ... = cxk = 
(a.s.). 

Theorem 3. For any strategy A ^ A*, there exist a random variable 7(w) > and 
a constant c < such that with probability one, limsup^^ i -1 Irixf < c for all 
< a < 7(cj). 

Proof. We apply Theorcm[T]with X = (— oo, +oo) and X(u>) = [0, oo). We define 
the function f(x,oj) as the right-hand side of (16.2[) with t = if x = x t > —((lj), 
where £(w) :— min^ A£(w). For x < —((lu), we can define f(x,uj), for example, as 
any (fixed) number u. Clearly x :— is a fixed point of f(x,uj) for each u>. For 
< x < 1, we have < x~ 1 f(x,uj) < 2(~ 2 , so that (Bl) holds with 6 = 1 and 
L = 2(~ 2 . Further, 

K A fc 
fe=l A fc 

By virtue of Jensen's inequality, we have 



K , K , K , K 




To show that the above inequality is indeed strict, assume the contrary. Then 
the random variable X^fcLi MfcAfc/A^ coincides a.s. with an J^-measurable random 
variable. Hence it coincides a.s. with its conditional expectation given J-o, which is 
equal to 1 (this follows from (JfTT]))- Thus Y^k=\ MfeAfc/A^ = 1 (a.s.) or equivalently, 
EfcUM(Afc/A*)-l] = (a.s.), which implies by virtue of (K2) that (A fe /A*)-1 = 
(a.s.) for all k = 1,2, ...,K. Consequently, A = A*, which is a contradiction. □ 
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7. Sufficient conditions in the Markovian case 

We conclude with some comments regarding hypotheses (Kl) and (K2). These 
hypotheses are formulated in terms of the Kelly strategy A*, which is defined as 
the solution to equation (16.11) . For the applications it is important to provide 
conditions sufficient for (Kl) and (K2) that are formulated in terms of one of the 
primitives of the model — the dividend process Rt- The former condition holds 
if Slnminfe EqRi^ > — oo, which is clear from (|6.1[) . The latter is satisfied, for 
example, if the following requirements are fulfilled: 

(i) the random variables i?i,fe, k = 1, ■■■,K, are conditionally independent given 
Fo (the absence of "redundant" assets); 

(ii) the probability space (f2, F, P) and the filtration (Ft) are generated by a 
stationary Markov process s_i, so, s\, ... with values in a measurable space S, 
and the vector function R(ui) depends only on sq (we shall denote it as R(sq)); 

(iii) the process St has a transition function Tr(s,da) possessing a jointly mea- 
surable density p(s, a) with respect to a probability measure ir(da) such that 
< v < p(s, a) < V for some constants v < V. 

Let us prove that conditions (i)-(iii) imply (K2). We first observe that in the 
Markov case, A£ = A£(so) and /ik = Mfc(si) are functions of sq and s\, respectively. 
It follows from (|6.ip that /i satisfies 

(7.1) rE of i( Sl ) + (1 - r)R{s ) = n(s ) (a.s.). 

In the present setting, J^-measurable functions can be identified with measur- 
able functions a(s'), where s* := (..., st-i, St). Let ai(s°), ax(s°) be an Fq- 
measurable vector functions satisfying 

(7.2) (a(s°),/i( Sl )) =0(a.s.), 

where a := (ai,...,ax) and /i = (n\, /J-k). We have to prove that a = (a.s.). 
From (|7.1j) we get 

(7.3) r(a( S ~ 1 ),£;oA*(si)) + (l-^(a(^ 1 ),i?(so)) - (a(fl _1 ), /i(«o)> (a.s.). 
Let us show that i?|(a(s _1 ), ^^(si)) = 0. We have 

^Ka^ 1 ),^^^!))! = S^o^Gs- 1 ),^^!))! < EEoKais- 1 ),^)^ = 

(7.4) ^Ka^ 1 ),^^!))! = EE^Kais' 1 ),^)^. 
From (iii) we get p(s,a) < Vv^ 1 p(s-i,a). By using this, we obtain 

S_ 1 |(a(s _1 ),^(s 1 ))| = / 7r(s_!,ds) / 7r(s, da) I (a(s _1 ), /Lt(cr))| = 



7r(s_i,<is) / p(s, a)ir(d<7)\(a(s 1 ),/i(<r))| < 
I/u" 1 / w(s-x,ds) / p(s_i,cr)7r(dcr)|(a(s" 1 ),/z(cr))| 



(7.5) Vv- 1 / ^(s-!,^)!^- 1 ),^^))! = 7u- 1 J B_ 1 |(a(s- 1 ) ) /i(s ))| 



By combining (173)) . (fT4l) and (|7T2j) . we obtain that E^ats" 1 ). E n p,(si ))\ = 0. This, 
together with ()7.2j) and ()7.3|) . implies the equality (a(s _1 ), R(sq)) = (a.s.). By 
using (i) we conclude that a(s^ 1 ) = (a.s.), or equivalently, a(s°) = (a.s.), which 
completes the proof. 
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